Click any tag below to further narrow down your results
Links
Randy Au argues that LLMs can take over tedious coding work in data analysis, but exploratory data analysis still needs a human who understands the data's context and intent. He says current models make poor analytical decisions and that the act of poking at data is how analysts sharpen their hypotheses.
- Exploratory analysis depends on intent: the same numbers look "correct" or "weird" depending on what you plan to do, and an LLM has no access to that purpose unless you spell out a huge amount of business context.
- Coding agents lack a feedback signal for analytical quality, so they confidently run off on flawed approaches. Au says he had to micromanage them to the minute detail, and the promised analysis often didn't match what was delivered.
- Hypothesis generation happens through hands-on iteration with the data. Offloading that work skips the process where questions get refined and interesting correlations get noticed.
DuckDB released a plugin that lets Claude Code query data files directly using SQL instead of writing Python scripts, making it faster and more accurate. The plugin handles everything from local CSVs to remote cloud storage and spatial data, with Claude automatically picking the right tool based on what you ask.
- Claude can now run SQL queries against any file format (CSV, Parquet, JSON, Excel, etc.) on disk or in cloud storage, getting exact answers instead of guessing column names
- The plugin includes specialized skills for S3/GCS exploration, spatial queries (distances, nearest neighbors), searching DuckDB docs, and recalling decisions from past sessions
- When a query fails, Claude reads the error message and retries with corrected SQL automatically, creating a two-layer conversation (natural language with you, SQL with DuckDB)